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O 
Commonwealth 


Vision 
Ensure each and every student is empowered and equipped to pursue a successful future. 
Mission 


To partner with districts, schools, families, students, business and industry, and communities 


to provide leadership and support to ensure success for each and every student. 


About 


The Kentucky Department of Education is a service agency of the Commonwealth 
of Kentucky, and part of the Education and Workforce Development Cabinet. The 
department provides resources and guidance to Kentucky’s public schools and districts 
as they implement the state’s P-12 education requirements. The department also serves 


as the state liaison for federal education requirements and funding opportunities. 


INTRODUCTION 


The Kentucky Department of Education (KDE) has identified 
closing the achievement gap as a key priority for the state. To 
best support districts and their work, it is important that we 
have a clear understanding of the current achievement gap, 
as well as the progress being made to close the gap. A growth 
measure is one tool we can leverage to describe districts’ 
performance over time, allowing us to move from a single 


snapshot to a broader view of district progress. 


The purpose of this study is to investigate the progress being 


made to close the current achievement gap in Kentucky. 


KEY FINDINGS 


WHILE THE ACHIEVEMENT GAP CONTINUES TO 
POSE A CHALLENGE TO MOST DISTRICTS, THE 
DEGREE TO WHICH DISTRICTS ARE MAKING 
PROGRESS IN CLOSING THEIR RACIAL AND 
SOCIOECONOMIC GAPS VARIES WIDELY ACROSS 
THE STATE. 


Figure 1 shows the distribution of districts’ progress in closing 
the achievement gaps in 3rd grade mathematics.’ Districts 
whose growth scores were less than zero showed progress in 
closing their achievement gaps. Pike County, for instance, was 
predicted to decrease its racial achievement gap in mathematics 
to 9.8 scale scores. However, its actual gap decreased to 4.3, 
which represents a difference of -5.5 scale scores in growth. 
Conversely, districts with growth scores greater than zero had 
achievement gaps that were larger than predicted. For example, 
Bullitt County was predicted to slightly increase its racial 
achievement gap in mathematics from 11.1 to 11.4; however, its 
actual gap rose to 19.3, representing a difference of 7.9 scale 


scores in growth. 


Guiding the study is the following research question: Which 
districts are closing racial and socioeconomic achievement gaps 
at rates that exceed expectations? We assess districts’ progress 
in closing racial and socioeconomic achievement gaps in school 
year 2017-2018 by employing a growth measure—specifically, 
a residual gain model—to estimate districts’ expected 


achievement gaps from prior years’ achievement gaps. 


The sections below describe the primary findings of the 
analysis and next steps for research. An overview of the study’s 


methodology is also given at the end of the brief. 


Looking at the state as a whole, we found considerably more 
variation in districts’ progress in closing the racial achievement 
gap (sd = 10.7) than the socioeconomic achievement gap (sd = 
4.68). This pattern was consistent across all grades and similar 
to findings in reading. It is worth noting that there were a 
number of districts (n = 12) that outperformed their predicted 
racial achievement gap by more than 5 scale scores. However, 
there were roughly the same number of districts (n = 17) whose 
racial achievement gap was 9 scale scores larger than their 
predicted gap. Together, these findings show that some districts 
are making progress in closing their achievement gaps, whereas 


others are failing to do so and, in some cases, regressing. 


"We use 3rd grade mathematics as an example throughout the 
report. Results for reading and other grade levels are available 


upon request. 


Figure 1. Distribution of Districts' Growth Score, Grade 3, Mathematics 
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DISTRICTS THAT PROGRESSED IN CLOSING 
THEIR MATHEMATICS ACHIEVEMENT GAP OFTEN 
PROGRESSED IN CLOSING THEIR READING GAP 
TOO. 


Figure 2 highlights the relationship between 3rd grade 
mathematics and reading growth scores for racial and 
socioeconomic achievement gaps. There were 37 (21.4%) 
districts that progressed in closing both the racial 
achievement gaps in mathematics and reading and 68 
(39.3%) districts closed the socioeconomic gaps in both 
subjects.” For example, McLean County outperformed its 
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predicted racial achievement gap with growth scores of -24.0 
and -23.7 in mathematics and reading, respectively. Similarly, 
Menifee County performed better than expected in closing 
its socioeconomic gap in both mathematics and reading by 
-11.2 and -10.2 growth scores, respectively. On the other 
hand, 46 (26.6%) districts regressed in their progress toward 
closing the racial achievement gaps and 66 (38.2%) saw worse 
than expected socioeconomic gaps in both mathematics and 
reading. Similar results were found in Sth and 8th grades. 


* In calculating percentages, we excluded districts with missing 
information. 


Figure 2. Relationship between Mathematics and Reading Achievement Gaps 
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CONCLUSIONS AND FUTURE RESEARCH 


In summary, a number of districts show progress in 


achievement gap closure. However, decreasing the racial and + _ Expanding the model to include additional years of 
socioeconomic achievement gaps continue to be a challenge achievement gap data and continuing to tune model 

for many districts. It is important to note a growth measure is performance. 

one way of examining the achievement gap. While a growth + _ Investigating historical growth trends and proposing 
measure describes districts’ movement toward gap closure, benchmarks for adequate growth. 

it does not necessary highlight districts that saw an actual + Modeling racial and socioeconomic achievement gaps at 
decrease in their achievement gap. Such information may be the school level. 

more pertinent to policymakers. Currently, we are developing + — Constructing an interactive dashboard for KDE leadership 


research in this area. Other future research topics include: to monitor achievement gaps across schools and districts. 


SUMMARY OF METHODOLOGY 


To facilitate this analysis, we used student-level assessment 
data from KDE’s Office of Standards, Assessment, and 
Accountability data files for schools years 2016-2017 and 
2017-2018. Data files contained scale scores for the K-PREP 
mathematics and reading tests as well as demographic and 
program information for all 3rd, Sth, and 8th grade students 
attending a public school in the state.” We aggregated 

these data by grade and district using information about the 
school and district that the student attended, and estimated 
within-year achievement gaps for districts’ racial/ethnic and 
socioeconomic groups.” The subsequent district-level dataset 
was then supplemented with district characteristics (i.e., 
program information, attendance, Title |, etc.) from the School 


Report Card. 


In order to examine districts’ progress on closing racial and 
socioeconomic achievement gaps, we estimated a series 
of residual gain models. All models included variables that 


controlled for student and district characteristics.” It is 


important to note that the decision to include district-level 
variables in the model significantly decreased the precision of 
our estimates. For example, we found districts’ prior year racial 
and socioeconomic achievement gaps to be weakly correlated 
to their current year gap (r = .18 andr = .35, respectively). 
While we recognize this limitation to our study, we believe 

an approach that takes multiple years of data into account to 
estimate the achievement gap to be an improvement over an 
approach that compares district achievement from one school 


year. 


* We limited our study to students who are transitioning to the 
next education level. 

* A number of districts (n = 61) did not have any black students 
enrolled in 3rd, Sth, or 8th grade. In turn, we were unable to 
calculate an achievement gap for those districts. 

* The full model specification and performance metrics are 


available upon request. 


Program information: 
Office of the Commissioner 
300 Sower Blvd 

Frankfort, KY 40601 


